/AD-A194  215  COMMENTARY  ON  HAROLD  HOTELLING'S  ARTICLES  ON  THE  1/1 

TEACHING  OF  STATISTICS*!!)  PURDUE  UNIV  LAFAYETTE  IN  DEPT 
OF  STATISTICS  S  S  GUPTA  APR  88  RR-88-12 
UNCLASSIFIED  N00014-88-K-0170  F/G  12/3  NL 


AD-A194  215 


•  OIIC  Fil£  Cut: 


COMMENTARY  ON  HAROLD  HOTELLING’S  ARTICLES 
ON  THE  TEACHING  OF  STATISTICS* 


Shanti  S.  Gupta 
Purdue  University- 


Technical  Report#88-12 


PURDUE  UNIVERSITY 


OTIC 

.ELECTE! 

APRt  21988 

^  cbd 


c  n 


e>* 


DEPARTMENT  OF  STATISTICS 


'Dl£THI3UT10NjiS":'''-  - 

to  ^rvl 

p'ntribubon  - 


8  8  4  12 


COMMENTARY  ON  HAROLD  HOTELLING’S  ARTICLES 
ON  THE  TEACHING  OF  STATISTICS* 


by 

Shanti  S.  Gupta 
Purdue  University 

Technical  Report#S8-12 


a  r  ' 

it  t 

*  r '  -  *  f 

■  V/  v.i  *■"  k-  ^  * 


Ahk  1  L  1d88 


Department  of  Statistics 
Purdue  University 

April  1988 


*  The  writing  of  this  paper  was  supported  in  part  by  the  Office  of  Naval  Research 
Contract  N00014-88-K-0170  at  Purdue  University. 


COMMENTARY  ON  HAROLD  HOTELLING’S  ARTICLES 
ON  THE  TEACHING  OF  STATISTICS* 


by 


Shanti  S.  Gupta 
Purdue  University 


I  would  like  to  express  my  appreciation  to  Professor  Morris  DeGroot  for  inviting  me 
to  comment  on  the  two  papers  of  Professor  Harold  Hotelling.  During  the  three  years 
(1953-56),  as  a  graduate  student  at  the  University  of  North  Carolina  at  Chapel  Hill,  I 
took  several  courses  from  Professor  Hotelling  and  attended  several  of  the  famous  Sunday 
tea  parties  given  by  him  and  Mrs.  Susanna  Hotelling  in  their  lovely  home  on  the  first 
Sunday  of  each  month  (the  atmosphere  at  these  gatherings  at  Hotellings’  t’s  used  to  be, 
indeed,  quite  stimulating  and,  of  course,  very  very  sociable). 

Introduction 

It  is  close  to  half  a  century  since  the  first  of  these  two  papers  by  Hotelling  was  pub¬ 
lished.  The  second  paper,  published  nearly  a  decade  after  publication  of  the  first,  re¬ 
examines  the  issues  raised  in  the  first  and  amplifies  on  the  organizational  and  teaching 
personnel  issues.  For  one  who  reads  (or  rereads)  these  papers,  the  striking  fact  is  the  thor¬ 
oughness  with  which  Hotelling  has  analyzed  the  many  issues  that  could  and  would  arise 
in  the  teaching  of  statistics.  In  1940,  statistics  was  not  yet  thought  of  as  an  independent 
discipline  of  study.  The  subject  was  still  very  young.  There  were  only  a  handful  of  pio¬ 
neers  —  Hotelling  one  among  them  —  doing  research  that  can  be  classified  as  theoretical 
or  mathematical  statistics  as  we  know  it  today.  Many  of  the  personalities  that  would  come 
later  and  leave  their  impact  on  the  history  and  development  of  the  subject  were  yet  to 
embark  or  had  hardly  embarked  upon  their  careers  in  statistics.  It  is  in  this  context  that 

*  The  writing  of  this  paper  was  supported  in  part  by  the  Office  of  Naval  Research 
Contract  N00014-88-K-0170  at  Purdue  University. 
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Hotelling’s  discussion  and  analysis  of  the  issues  involved  in  the  teaching  of  statistics  stand 
out  so  distinctively  for  the  foresight  and  clarity  exhibited. 


In  analyzing  the  problems  associated  with  teaching  of  statistics  in  universities, 
Hotelling  has  viewed  the  topic  as  consisting  of  three  inseparably  connected  issues:  teach¬ 
ing,  research,  and  consulting.  Many  of  the  problems  discussed  here  are  typically  still  with 
us,  some  have  been  resolved  the  way  he  foresaw  or  recommended,  and  some  would  come 
back  in  different  contexts  as  the  subject  itself  were  to  grow.  It  is  in  this  light  that  we- 
reexamine  these  papers. 


One  of  the  main  problems  still  faced  on  many  university  campuses  across  the  country 
is  that  of  duplication  of  basic  statistics  courses  and  the  much  debated  question  of  who  is 
best  qualified  to  teach  these.  The  nature  of  this  problem  is  clearly  stressed  by  Hotelling 
who  sees  it  as  a  fact  that  is  “often  concealed  by  including  the  teaching  of  statistical  theory 
in  a  course  whose  title  and  prospectus  are  more  suggestive  of  applications.”  His  example 
(given  in  both  papers)  how  a  course  in  Price  Forecasting  ended  up  as  a  course  in  statistical 
theory  with  virtually  nothing  about  forecasting,  should  sound  familiar  to  many  of  us.  The 
last  straw  for  him  is  “putting  the  Department  of  Education  in  charge  of  an  essential  part 
of  the  training  of  scientific  students.”  This  problem  of  overlapping  and  duplicating  of 
elementary  statistics  courses  can  be  solved  by  understanding  the  reasons  (as  put  forth  by 
Hotelling)  why  it  is  in  the  interests  of  all  users  of  statistics  that  the  elementary  teaching 
of  statistics  should  be  “conducted  by  those  with  a  thorough  and  critical  knowledge  of 
current  research  in  statistical  theory.”  This  is  no  less  true  today  than  when  Hotelling 
recommended  it  as  “perhaps  the  greatest  reform  needed  in  teaching  of  statistics  today.” 


Teachers  of  Statistics  and  Organizational  Setu 


In  both  papers,  Hotelling  has  discussed  in  detail  the  qualifications  necessary  for  teach¬ 
ers  of  statistics  and  the  organizational  aspects  of  carrying  out  the  teaching.  In  the  1949 
(First  Berkeley  Symposium)  paper,  he  has  listed  in  decreasing  order  of  desirability  five 
different  ways,  the  teaching  of  statistics  can  be  organized.  Perhaps,  there  are  still  a  few 


places  today  with  the  last  (fifth)  setup  in  which  the  teaching  is  disorganized  among  a 
heterogeneous  group  of  departments  of  application. 

The  fourth  possibility  of  having  it  under  the  exclusive  jurisdiction  of  the  Department 
of  Mathematics  exists  in  quite  a  few  places  in  a  modified  form  in  the  sense  a  small  part 
of  elementary  courses  are  taught  by  some  departments  of  application  such  as  psychology, 
business,  and  economics.  However,  this  still  requires  that  teaching  of  statistics  even  at  lower 
levels  is  entrusted  to  qualified  specialists  who  have  “a  genuine  sympathy  and  understanding 
for  applications.”  As  we  all  know  today,  there  is  still  the  problem  of  the  perception  by 
others,  as  Hotelling  feared,  that  “courses  in  statistics  given  by  a  department  consisting 
largely  of  pure  mathematicians  are  unsuitable  for  their  purposes.” 

The  third  setup  is  to  have  an  interdepartmental  committee  in  charge  of  statistics. 
This  was  not  viewed  (then)  by  Hotelling  and  is  not  considered  now  by  many  as  anything 
more  than  a  makeshift  until  a  proper  Department  of  Statistics  is  organized. 

The  second  setup  of  a  Department  of  Statistics  is  what  has  largely  evolved  in  the 
intervening  decades.  This  has  provided  for  the  smooth  transition  in  many  universities  and 
has  helped  the  healthy  growth  of  graduate  programs  in  statistics  as  well  as  fostering  funda¬ 
mental  research  in  theoretical  statistics.  This  has  provided  the  right  kind  of  environment 
to  gather  teachers  of  statistics.  The  importance  generally  accorded  to  teaching,  research, 
and  university-based  consulting  in  a  typical  department  is  just  what  Hotelling  is  describ¬ 
ing.  A  Department  of  Statistics  should  have  “full-time  professors  engaged  in  the  teaching 
of  and  research  in  statistical  theory  and  methods,  without  spending  time  over  applied  sta¬ 
tistical  problems  excepting  insofar  as  such  problems  might  present  novel  features  calling 
for  the  development  of  new  statistical  methods  or  theoretical  extensions  having  interest 
going  beyond  the  immediate  case.”  He  rightly  visualizes  the  academic  statistician  as  a 
toolmaker  who  “must  not  put  all  his  time  on  using  the  tools  he  makes”  but  must  focus  his 
attention  on  tools  themselves. 

The  top  preference  is  for  a  two-department  Institute  of  Statistics,  one  department 
dealing  with  theoretical  statistics  and  the  other  with  applied  statistics,  with  migration  of 


k) 


faculty  from  one  to  the  other  made  easy  and  frequent  but  not  rigid  with  periodic  transfers. 
Such  a  setup  is  generally  possible  only  in  larger  institutions.  It  is  desirable  to  have  a 
general  setup  which  serves  as  an  umbrella  for  persons  working  in  different  areas  who  have 
common  interests  and  possible  desire  to  work  on  interdisciplinary  projects.  A  Center  for 
Statistical  Decision  Sciences  such  as  the  one  recently  started  at  Purdue  University  provides 
such  a  forum  and  working  arrangement. 

Undergraduate  and  Graduate  Curricula 


Some  of  the  deficiencies  seen  be  Hotelling  have  been  corrected  but  some  others  do 
persist  in  some  form  or  other  partly  because  of  the  constant  growth  of  the  subject  itself. 
Until  the  early  seventies,  there  were  not  many  statistical  courses  to  speak  of  at  sophomore 
level.  Generally,  courses  at  senior  level  with  a  calculus  prerequisite  were  available.  A 
graduate  student  in  sociology,  for  example,  never  had  any  elementary  statistics  course  as 
an  undergraduate.  Now  many  undergraduates  do  take  elementary  courses  in  statistics. 
However,  “a  better  integration  of  undergraduate  with  graduate  work”  is  still  a  far  cry  as 
far  as  statistics  is  concerned. 

The  important  point  that  is  emphasized  by  Hotelling  without  missing  a  single  oppor¬ 
tunity  is  the  sound  mathematical  basis  needed  for  pursuit  of  statistics.  Such  a  need  has 
never  been  greater  than  today  given  the  recent  developments  and  current  trends.  It  is  cer¬ 
tainly  debatable  whether  every  Ph.D.  student  in  theoretical  statistics  is  equipped  enough 
mathematically.  To  function  well  as  a  consultant  to  research  workers  in  other  fields  in  the 
university,  a  statistician  needs  “a  somewhat  wider  diffusion  of  studies  among  various  fields 
than  is  customary  in  many  institutions,  especially  in  graduate  work.”  This  need  as  well  as 
the  advantage  of  familiarity  with  empirical  data  deserve  the  attention  of  educators. 

Related  closely  with  the  problem  of  proliferation  of  basic  courses  in  statistical  methods 
is  the  problem  of  many  textbooks  written  which  propagate  errors.  What  we  really  need 
are  textbooks  that  “abandon  the  idea  of  telling  what  statistical  methods  are  used,  and  say 
instead  what  methods  ought  to  be  used.” 


Concluding  Remarks 

As  pointed  out  above,  Hotelling  has  examined,  very  critically,  the  problem  of  teaching 
of  statistics  in  colleges  and  universities  and  offered  several  recommendations.  As  far  as  the 
curricula  are  concerned,  he  did  not  anticipate  the  extent  to  which  computers  would  come  to 
influence  the  teaching  of  statistical  methods.  The  problems  pointed  out  by  Dr.  Hotelling 
still  remain  in  many  universities  and  colleges.  The  disorganization  of  their  statistical 
programs,  the  proliferation  of  statistics  courses,  and  deficiency  of  selecting  suitable  teachers 
to  teach  statistics  courses  are  just  some  of  the  areas  where  improvements  are  needed. 
Many  universities  still  have  not  established  the  Institute  of  Statistics  or  the  Department 
of  Statistics  as  envisaged  by  Hotelling.  If  students  in  this  country  had  had  calculus  at  an 
early  stage,  say,  in  high  school,  “statistical  teaching  could  be  made  more  efficient." 

Although  the  1940  paper  was  Hotelling’s  invited  address  at  the  Hanover  Meeting 
of  the  Institute  of  Mathematical  Statistics  that  year,  he  did  not  address  himself  to  the 
possible  role  of  professional  societies  such  as  the  Institute  of  Mathematical  Statistics  and 
the  American  Statistical  Association  in  influencing  the  teaching  of  statistics  in  universities. 
For  a  discussion  of  this  role,  see  Tanur  (19S2)  and  Gupta  (19S2). 
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